Measuring human movements—method and apparatus

ABSTRACT

A method and apparatus are disclosed for measuring human movement of a test subject during a standard coordination and balance test. The test subject is placed in a selected test position, e.g. standing on one leg for a selected test period. A sensor device is attached to at least one body member of the test subject. The sensor generates and transmits a signal representative of movement of the body member during the test (hereinafter “the test”). The test subject is viewed through a viewfinder of a visual recorder. The recorder and sensor device are activated and generate image and sensor signals which are transmitted to an analyzer for determining the movement of the body members during the test. A coordination and balance score is calculated from the test based on the body movement, body member location and test time. The score is compared a standard associated with the test, and provides an indicator of the test subject&#39;s coordination and balance skill.

BACKGROUND

1. Field

Embodiments of the invention relate to human movement measurement andanalysis.

2. Description of Related Art

Apparatus and methods that provide feedback regarding a person'sphysical activities are divided into three categories including; basicactivities, aerobic activities and coordination activities.

Basic activities are measured with steps, walk distance and energyconsumed. Improvements in basic activities are measured with adevelopment of accumulated steps per a certain period (i.e. weeks,months.). Aerobic activities are measured in running distance, velocityand heart rate. Improvements in aerobic activity are measured as themaximal oxygen intake. Coordination activities are measured as activityintensity and heart rate. Improvements in coordination are measured withcoordination and balance tests.

The measurement of basic and aerobic activities is relatively straightforward for a test subject as compared to the measurement ofcoordination and balance skills. The latter involves capturing andmeasuring the amount of movement by different body members of a testsubject during a physical test over a selected time period. Accordingly,what is needed in the art is an apparatus and method for capturing andmeasuring movement of different body members of a test subject during aphysical test, wherein the apparatus and method are flexible fordifferent coordination and balance skills and the test results arereproducible.

SUMMARY

The body members are equipped with sensor devices 104 which transmit asignal representative of the associated body member movement, shouldsuch occur during the coordination and balance test (hereinafter“test”). The sensor devices are taken from the group comprising standardaccelerometers, magnetometers, angular rate sensors, gyroscope and thelike. One or more of the sensor devices may be included in a gamedevice, a mobile phone, a mobile communication device, an audio/videoplayer, a position detecting device, and the like. Any movementsignal(s) is transmitted as sensor data to a visual recording device106, in one embodiment a portable video camera phone held by aphotographer (not shown). In another embodiment, the recording devicemay be a stationary visual recording device with timing control. Whenthe one or more sensor devices 104 are attached to the body member'sinformation on which body member the sensor is attached is delivered ortransmitted to an analyzing device. This may happen e.g. in a pairingphase between devices. Alternatively, when a specific test is selectedin an analyzing device, also, information is given, e.g. on a display ofthe analyzing device, on which one or more body members one or moresensor devices should be placed. The sensor signals are transmitted byshort-range communication protocols including Bluetooth® protocols,Infra-red Data Association (IrDA) protocols, Wireless Local Area Network(WLAN) protocols, UWB (Ultra Wide Band) protocols, and the like. Therecorder 106 includes a processor, transceivers and the like which willbe more fully described in conjunction with the description of FIG. 4describing the processing of the sensor data for test results. Inanother embodiment the processor may be a separate standalone unit andnot included in the recorder. Alternatively, the sensor device 104 maybe a sticker having some specific color. One or more stickers can beattached to the limbs and torso of the body so that every sticker hasits own color. Later, an analyzing program can detect the stickers withspecific colors and analyze movement based on the sticker movements.Now, a specific color may mean a specific body member.

DESCRIPTION OF DRAWINGS

Embodiments of the invention will be further described in a Descriptionof Embodiments taken in conjunction with appended drawings, in which:

FIG. 1 is a representation of a testing process for a test subjectincluding sensor devices in a test position captured by a visualrecording device for measuring coordination and balance skill of thetest subject and incorporating the principles of embodiments of theinvention;

FIGS. 2 A, B and C are representations of templates including an outlineof a test subject in different test positions for use in the visualrecording device of FIG. 1;

FIG. 3 is a representation of a viewfinder in the visual recordingdevice of FIG. 1, the viewfinder displaying a template of FIG. 2A withthe test subject displayed within the outline for use in determining themovement of body members of the test subject during a coordination andbalance test.

FIG. 4 is a representation of an analyzer linked to a processor forprocessing image movement signals representative of body part members'movements and sensor signals representative of body part membersgenerated by the process of FIG. 1 and providing a combined test resultfor the coordination and balance skills of the test subject.

FIG. 4A is a representation of software stored in a memory included inthe analyzing terminal of FIG. 4 for managing the analyzer in theprocess of FIG. 1.

FIG. 5 is a flow diagram of the process of FIG. 1 in selecting testpositions, generating, and displaying data representative of themovement of body members of the test subject during a coordination andbalance test.

DESCRIPTION OF EMBODIMENTS

Referring to FIG. 1, depicting one aspect of the invention, a testingprocess 100 is shown being conducted to measure the coordination andbalance of a human or test subject 102 for participating in sportactivities or physical activities involving the risk of injury during aphysical event. As defined in the Encyclopedia of Nursing, coordinationis the capacity to move through a complex set of movements that requiresrhythm, muscle tension, posture, and equilibrium. Coordination isgenerally measured by scoring the test subject's ability to perform thecomplex set of movements. Balance is the ability to maintain the centerof gravity over the base of support, usually while in an uprightposition. Balance is measured by ability of the test subject to maintainbalance, either statically or while performing various functionalmovements. The Berg Balance Scale (BBS) described in the Encyclopedia ofNursing is a recognizable tool for measuring balance.

The test subject 102 in FIG. 1 has assumed one of several test positionswhich may be used to measure coordination and balance based on theamount of movement of the test subject's body members, i.e. arms, legs,hands, torso and head during a test period. The test subject should bepositioned in front of a plain background 103 for photographic reasons,as will become apparent hereinafter.

An apparatus, a method, and a non-transitory computer readable storagemedium are provided. The computer readable storage medium carries one ormore sequences of one or more instructions which, when executed by oneor more processors, cause the apparatus to perform the method formeasuring movement of different body members of a test subject during atest period, wherein the measurements provide an indication ofcoordination and balance skills of the test subject. The test isconducted by the test subject performing a series of physicalactivities, which may be static or dynamic. The movements of the testsubject during the test are captured, measured and compared tostandardized results for the activity as an indicator of thecoordination and balance skills of the test subject. In one activity,the test subject assumes a test position, for example, standing on oneleg while the other leg is raised. In another activity, the test subjectmay stand on one leg with hands in different positions. In still anotheractivity, the test subject may stand on one leg with different torsopositions or performing different hand movements with blinded eyes.During the test, a visual recording device, typically a video camera andcommunication device records the test subject movement in the testposition during the test period. A template including an outline orcutout of the test position may be placed in the view finder of therecording device. The camera is operated to zoom the test subject withinthe cutout of the template during the test. The template may be placedin the recording device before or after capturing the image/video data.The template enables the captured image data to show the test subject'smovement during the test. The image/video data is translated intosignals representative of the movement by the test subject during thetest and provided to a first analyzer. The test subject further includessensory units attached to body members for generating signals indicativeof the movement of the body members during the test. The sensor signalsare captured and represent the movement of the body member associatedwith the sensor during the test. The sensor data is provided to a secondanalyzer. A processor having access to stored programs instructs thefirst analyzer and the second analyzer in calculating the amount ofmovement from the image/video signals and the sensor signals using thesignal length or other signal parameter as a measure of the movement. Atest score is calculated from the amount of movement and the test time.The test score is representative of the test subject's coordination andbalance skill, and is compared to a standard developed from experientialdata or a testing organization.

FIG. 2A, depicting one aspect of the invention, shows an example view ina standard viewfinder in the recorder 106. A template 200 is displayedin the viewfinder. The template includes an outline or cutout 202 of atest position 204 of the test subject 102 (see FIG. 1) standing on oneleg with hands outstretched for balance, as shown in FIG. 1. FIG. 2B isanother template 206 showing an outline 208 of the test subject in atest position 210 standing on one leg with the hands in differentposition from the hands in FIG. 2A. FIG. 2C is still another template212 of the test subject showing an outline 214 in a test position 216with hands extended with the test subject's eyes blinded by a cover (notshown). The templates may be installed in the viewfinder before the testsubject's image is recorded or after the image is recorded by therecorder 106 (see FIG. 1).

In one embodiment shown in FIG. 3, the test subject 102 is viewed by therecorder 106 through the viewfinder (not shown) with the test subjectwithin the outline or cutout 202 in the template 200 while the “test” isconducted over a test period. The visual movement(s) of the testsubject's body members which overlap the outline 202 is detected by therecorder, in one embodiment a video recorder, and translated intoelectrical signals as image/video data representative of the movement ofthe body member. The image/video data may include a header assigned bythe camera for identifying the body member. The image/video data istransmitted to an analyzer to be described in FIG. 4. The visualrecorder may be a portable unit or a stationary standalone unit.

In an alternative embodiment of the invention, the test subject 102 isviewed by the recorder 106 through the viewfinder (not shown) withoutany outline or cutout 202 in the template 200 while the “test” isconducted over a test period. In this case, a virtual template is fittedover a starting image of the test subject in the analyzing process.Later, the result of the analyzing process is displayed with capturedvideo with the test subject with the outline or cutout 202 in thetemplate 200.

FIG. 4, depicting one aspect of the invention, discloses an analyzingunit 400 included in the recorder 106 (see FIG. 1) or in a standaloneunit (not shown). Image/video data 402 is provided to an analyzer unit403 via a transceiver 1 using short-range communication protocols whenthe analyzer is not within the recorder. The analyzer 400 includes amemory unit 404 containing data and program instruction shown in FIG. 4Afor Visual Test Data—Movement 409; Sensor Test Data—Movement 411;Analyzer Software 412; Balance Test Standard 415; Comparison Software417; Communication Protocols 419 and an Operating System 421.Alternatively, the analyzer 400 may be a separate device of sensor andrecorder, like a personal computer or a network server.

The analyzer 400 translates electrical signals representative ofimage/video data into a movement measurement for a body member in termsof distance, where in one embodiment, the number of digital bits in thesignal is representative of body member distance movement. The analyzermay use other parameters of the signal to measure movement. The amountof movement is used in the calculation of a coordination and balancescore, where the balance score=f(amount_of_movement, time and bodymember location). The balance score can be compared to a standardizedbalance test or to a threshold as an indicator of the test subject'sperformance.

In like manner, sensor data 412 is provided to an analyzer unit 406 viatransceiver 2 when the analyzer is not within the sensor device. Thesensor data is processed into a movement distance for a body memberserviced by a sensor unit. In some instances there may be adjacentanalysis of image/video data and sensor data for a body member wheremovement is detected by both devices.

A CPU 408 is included in the analyzer for processing and providing theimage/video 402 and sensor data 411 as pairing data 410 and 412. Theimage/video data 402 and the sensor data, as pairing data, maybe used inan external device (like 104 and 106) or other, e.g. mobile gamingdevice, pedometer, global positioning system (GPS) device paired withthe recorder 106. The CPU also assembles the movement data and testresults for presentation at a user interface 414. The interface mayinclude a keyboard (not shown) to enable a user to select body membersfor test; test positions and the test period.

FIG. 5 is a flow diagram 500 of the test process 100 of FIG. 1, andincludes operations, as follows:

502—Selecting a desired test position, test period and template forinstallation into the visual recorder via the user interface 414. Nowinformation may be rendered on the selected test position to a user,e.g. on which body members the one or more sensor units 106 should beattached, e.g. in one use case, a mobile communication device with amotion sensor device in one of a test persons hand.

504—Attaching sensor units 106 to body members of the test subject 102.

506—Pairing of devices for providing the image/video data and the sensordata between the one or more sensor devices 104, one or more cameradevices 106, and/or optional external analyzing device. Providingpairing instructions for generating and transmitting pairing data fromthe image/video data and the sensor data.

508—Activating the visual recorder e.g. by pressing a trigger togenerate a recording signal enabling the visual recorder to captureimage/video data of the test subject relative to the template during thetest and substantially simultaneously sending a recording signalincluding a time stamp to activate the sensor devices to provide sensordata of body members during the test.

510—De-activating the visual recorder when the test period is completeand sending a signal with an end time stamp to de-activate the sensordevices.

512—Delivering the captured image/video data and the sensor data to theanalyzers for processing into movement data of the test subject duringthe test and providing a test score of the coordination and balanceskill of the test subject.

514—Presentation of the movement data and/or test score on a display inthe interface unit.

While embodiments of the invention has been described, various changescan be made therein without departing from the spirit and scope ofembodiments of the invention as defined in the appended claims, inwhich:

1. A method, comprising: causing, at least in part, recording images ofa test subject during a selected static balance test for a selected timeperiod by visual recorder; causing, at least in part, reception from atleast one sensor attached to at least one body member of the testsubject a signal representative of static balance of the body memberduring the test; and analyzing image data of the images and sensor dataof the signal to determine static balance of the test subject during thetest by: aligning one test specific static balance position templateover the test subject, and detecting positions of the body member of thetest subject that overlap one outline of the position template duringthe test.
 2. The method claim 1, further comprising: including thetemplate aligned in a viewfinder with the test subject during the testwherein the images of the test subject are recorded within the templateand the at least one sensor is activated during the test.
 3. The methodof claim 1, further comprising: calculating a static balance score forthe test subject during the test.
 4. The method of claim 3, wherein thestatic balance score is calculated based upon at least an amount ofmovement, a time period and a body member location.
 5. The method ofclaim 1, further comprising: comparing results of the test to a standardassociated with the test.
 6. The method of claim 1, further comprising:generating a signal to activate the at least one sensor.
 7. The methodof claim 6, causing, at least in part, installing a start time stamp inthe signal; and causing, at least in part, transmission of the signal toactivate the at least one sensor.
 8. The method of claim 6, whereincausing, at least in part, installing a stop time stamp in the signal todeactivate the at least one sensor.
 9. The method of claim 1, furthercomprising: causing, at least in part, displaying of an analysis ofstatic balance derived from the image and sensor data corresponding tothe at least one body member of the test subject during the test. 10.The method of claim 1, further comprising: causing, at least in part,transmission of the image and sensor data via at least one short-rangecommunication protocol.
 11. The method of claim 1, wherein the visualrecorder is selected from the group consisting of a portable cameraphone, a stationary time-controlled camera, a digital camcorder, and adigital camera.
 12. The method of claim 1, wherein the sensor isselected from the group consisting of an accelerometer, an angular ratesensor, a gyroscope, and a magnetometer.
 13. The method of claim 1,wherein a test position for a test subject is selected from the groupconsisting of standing on one leg, one leg standing with different handpositions, one leg standing with different torso positions, and one legstanding with different hand positions and eyes blinded.
 14. The methodof claim 1, further comprising: causing, at least in part, transmissionof the image and sensor data via radio waves, infrared light, a wirelesslocal area network (WLAN) link, or a combination thereof.
 15. The methodof claim 1, wherein the template is installed in a viewfinder afterrecording of the images.
 16. The method of claim 1, wherein the test isthe Berg Balance Scale (BBS).
 17. An apparatus, comprising: a visualrecorder configured to record images of a test subject during a selectedstatic balance test for a selected time period; a receiver configured toreceive from at least one sensor attached to at least one body member ofthe test subject a signal representative of static balance of the bodymember during the test; an analyzer configured to analyze image datareceived from the visual recorder and sensor data received from the atleast one sensor during the test by: aligning one test specific staticbalance position template over the test subject, and detecting positionsof the at least one body member of the test subject that overlap oneoutline of the position template during the test; and a processorconfigured to control the analyzer.
 18. The apparatus of claim 17,wherein the visual recorder and the analyzer are located in a samedevice.
 19. The apparatus of claim 17, wherein the sensor and theanalyzer are located in a same device.
 20. The apparatus of claim 17,wherein said processor calculates a static balance score for the testsubject during the test.
 21. The apparatus of claim 17, wherein saidprocessor controls the analyzer in calculating static balance data ofthe test subject during the test thereby providing a test score for thetest, and the processor compares results of the test to a standardassociated with the test.
 22. The apparatus of claim 17, wherein theprocessor or the visual recorder generates a signal to activate the atleast one sensor.
 23. The apparatus of claim 22, wherein the signalincludes a start time stamp therein to activate the at least one sensor.24. The apparatus of claim 22, wherein the signal includes a stop timestamp therein to deactivate the at least one sensor.
 25. The apparatusof claim 17, further comprising: a display configured to display ananalysis of static balance derived from the image and sensor datacorresponding to the at least one body member of the test subject duringthe test.
 26. The apparatus of claim 17, further comprising atransceiver configured to transmit the image and sensor data via atleast one short-range communication protocol.
 27. The apparatus of claim17, wherein the visual recorder is selected from the group consisting ofa portable camera phone, a stationary time-controlled camera, and adigital camera.
 28. The apparatus of claim 17, wherein the sensor isselected from the group consisting of an accelerometer, an angular ratesensor, a gyroscope, and a magnetometer.
 29. The apparatus of claim 17,wherein a test position for the test subject is selected from the groupconsisting of standing on one leg, one leg standing with different handpositions, one leg standing with different torso positions, and one legstanding with different hand positions and eyes blinded.
 30. Theapparatus of claim 17, further comprising: a transceiver configured totransmit the image and sensor data via radio waves, infrared light, awireless local area network (WLAN) link, or a combination thereof. 31.The apparatus of claim 17, wherein the template is installed in aviewfinder after recording of the images.
 32. A non-transitory computerreadable storage medium carrying one or more sequences of one or moreinstructions which, when executed by one or more processors, cause anapparatus to perform at least the following: recording images of a testsubject during a selected static balance test for a selected timeperiod; receiving from at least one sensor attached to at least one bodymember of the test subject a sensor signal representative of staticbalance of the body member during the test; and analyzing image data ofthe images and sensor data of the signal to determine static balance ofthe test subject during the test by: aligning one test specific staticbalance position template over the test subject, and detecting positionsof the body member of the test subject that overlap one outline of theposition template during the test.
 33. The computer readable storagemedium of claim 32, wherein said test subject is positioned in a testposition to measure coordination and balance skill of the test subjectduring the test for a selected time period, the test position isselected from the group consisting of standing on one leg, one legstanding with different hand positions, one leg standing with differenttorso positions, and one leg standing with different hand positions andeyes blinded.
 34. An apparatus, comprising: at least one processor; andat least one memory including computer program code, wherein the atleast one memory and the computer program code configured to, with theat least one processor, cause the apparatus to perform at least thefollowing: record images of a test subject during a selected staticbalance test for a selected time period; receive from at least onesensor attached to at least one body member of the test subject a sensorsignal representative of static balance of the body member during thetest; and analyze image data of the images and sensor data of the signalto determine static balance of the test subject during the test by:aligning one test specific static balance position template over thetest subject, and detecting positions of the body member of the testsubject that overlap one outline of the position template during thetest.
 35. The apparatus of claim 34, wherein said test subject ispositioned in a test position to measure coordination and balance skillof the test subject during the test for a selected time period, the testposition is selected from the group consisting of standing on one leg,one leg standing with different hand positions, one leg standing withdifferent torso positions, and one leg standing with different handpositions and eyes blinded.